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Abstract 

We discuss oscillations of atmospheric and solar neutrinos into sterile neutri- 
nos in the 2+2 scheme. A zero*^ order sum rule requires equal probabilities 
for oscillation into i^s and I'r in the solar+atmospheric data sample. Data 
does not favor this claim. Here we use scatter plots to assess corrections of 
the zero*'^ order sum rule when (i) the 4x4 neutrino mixing matrix assumes 
its full range of allowed values, and (ii) matter effects are included. We also 
introduce a related "product rule" . We find that the sum rule is significantly 
relaxed, due to both the inclusion of the small mixing angles (which provide 
a short-baseline contribution) and to matter effects. The product rule is also 
dramatically altered. The observed relaxation of the sum rule weakens the 
case against the 2+2 model and the sterile neutrino. To invalidate the 2+2 
model, a global fit to data with the smaU mixing angles included seems to be 
required. 
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I. INTRODUCTION 



Taken at face value, the solar, atmospheric, and LSND data require three independent 
Srri^ scales. Thus, four neutrinos seem to be required. The Z-boson width further requires 
that one of these four neutrinos be a "sterile" SU{2) x electroweak-singlet. Given the 
profound theoretical implication which would accompany the validation of a light sterile 
neutrino, and given the present experimental search for the sterile neutrino by the mini- 
BooNE experiment [1], a serious look at the present viabihty of the sterile neutrino is well 
motivated. 

It was shown some time ago that the non-observation of and disappearance by 
the Bugey and CDHS experiments, in conjunction with the appearance of v^, in the 

LSND experiment, strongly disfavored the 3+1 spectral hierarchy [2,3] in which the large 
"LSND" mass-splitting isolates one heavier mass eigenstate \vyC> from the other three. The 
conflict results because the Bugey and CDHS rates are proportional to | < i/gl^^H > P and 
I < v^\vYi > respectively, whereas the LSND rate is proportional to the product of the 
two; the upper limits from Bugey and CDHS doubly-suppress the rate allowed for LSND. 
However, when the final value of the LSND oscillation amplitude was reported to be smaller 
[4] than earher results, the 3-1-1 spectrum was resurrected at the 95% confidence limit for 
four isolated values of Sm^ [5-7]. Recently, a careful analysis of all data has led to the 
conclusion that even these isolated mass vahies are "highly unlikely," viable only if one 
super- conservatively accepts the tiny intersections of the 99% Bugey/CDHS exclusion curve 
with the 99% allowed region of LSND [8]. This 3-1-1 spectrum is a "separated-sterile" model, 
in that the sterile fiavor resides dominantly in the isolated mass-state and barely mixes with 
the three active fiavors; in the absence of the LSND data, the active-sterile mixing can be 
made arbitrarily small. 

On the other hand, the alternative 2+2 mass spectrum is compatible with the combi- 
nation of short baseline data. In the 2+2 spectrum, the LSND scale splits two pairs of 
neutrino mass-eigenstates. Phenomenologically, it is required that one pair mix i/^ with 1/^ 
and Vg to explain the atmospheric disappearance, while the second pair mix Ve with Ur 
and Us to explain the solar z/g disappearance. The small LSND amplitude, and the Bugey 
and CDHS limits are accommodated with a small mixing of into the first pair, and small 
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mixing of i^^ into the second pair [3]. In this model, the sterile neutrino is distributed in its 
totality between the solar and atmospheric scales. This leads to an approximate sum rule 
[9]. The essence of the sum rule is that the sterile neutrino may hide from solar oscillations, 
or from atmospheric oscillations, but cannot hide from both. When matter effects and small 
angles mixing the atmospheric and solar pairs are neglected, the sum rule states that the 
probabilities to produce Vg in the solar and atmospheric data sum to unity. 

The Superkamiokande (SK) experiment has put a limit on the atmospheric mode — > Vg 
[10]. In principle, the atmospheric data is sensitive to sterile neutrinos in three ways: (i) 
through differing matter effects for oscillation to Vj. vs. Vs\ ip) through neutral current 
scattering of Vt but not i/^, as measured by 7r° production; and (iii) through r appearance 
from scattering above threshold. However, the Super K analysis, following the guidelines 
in [11], ignores all parameters but 5m^tm) ^atm, and the VT-fs mixing angle 6rs- We will 
argue that the short baseline contribution from the large mass-gap (^^t^lsnd important if 
the small mixing angles are not too small, in which case the SuperK analysis is invalid for 
the 2+2 model. 

Limits on the solar mode result from model fits to the SK solar data [12], but 

especially from the recent SNO data. There is no evidence favoring a sterile admixture in 
the neutrino flux from the sun. Nevertheless, a large sterile component remains compati- 
ble with the SNO result [13,14], because of our uncertainty in the true high-energy solar 
neutrino flux produced by the reaction in the sun. It is unclear whether future measure- 
ments of intermediate-energy neutrinos in the BOREXINO experiment or the solar neutrino 
component of the KAMLAND experiment will help resolve this issue. 

Combined flts to solar and atmospheric neutrinos [15-17] have been performed. The 
authors of [16] came recently to the conclusion that a global analysis considering short 
baseline, solar, and atmospheric data gives a slightly better flt to (3-1-1) mass schemes 
compared to (2-1-2) schemes, though both four-neutrinos schemes are presently viable at 
low confldence. Most recently, a global analysis [17] has been performed which includes 
the LSND data, and newest SNO, SuperK, and MACRO data. The conclusion reached is 
that both the 2+2 and 1+3 sterile models are highly disfavored; the 2+2 analysis returns a 
goodness of flt of only 1.6 x 10~^. However, to reduce the number of parameters involved. 
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these papers set the two smallest mixing angles tested by short baseline experiments to zero 
in their fits to the solar and atmospheric data. 

In this work, we analyze the approximate sum rule in generality, varying the usually 
neglected mixing angles in their experimentally allowed ranges, and including possible matter 
effects. Our results indicate the allowed range of joint probability for i/s to reside in the solar 
and atmospheric data. We find that the allowed range may differ considerably from the zero*'* 
order result with small mixing- angles set to zero. Although it is not known whether the same 
values of the small angles which provide a large violation of the zero*'* order sum rule also 
provide good fits to the global data, the sensitivity to small mixing-angles demonstrated 
here suggests that global fits which neglect the small angles may underestimate the viability 
of the 2-1-2 model. This, in turn, casts some doubt on claimed exclusions of the 2-1-2 model. 
The ultimate arbiter on the viability of the sterile neutrino will be a global fit to data with 
all mixing angles included.^ 

II. FORMALISM 

The starting point for neutrino oscillations is the unitary transformation between mass 
and flavor basis: 

Wa >= Yl Kj Wj > > or <iyj\ Va >= (C/^)ja ; (l) 
3 

the inverse relation is 

>= E(^^)ia K >, or <U^\ Uj >= Uaj . (2) 

a 

We will consistently use roman indices for mass states, and greek indices for flavor states. 
The mass states luj > and therefore the transformation matrix U depend on matter densities, 
and so we will often affix a superscript or subscript label k, G {V, S,M,C} to \uj > and U 



Of the three small angles, we show that the sum rule is sensitive to and e^g, but not to Cee 
(in our notation), e^^ has been included in recent global analyses. Our findings suggest that, at a 
minimum, e^e should be included too. 
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to signify the vacuum, solar, earth's mantle, and earth's core environments, respectively. In 
addition, the labels A and E will sometimes denote the atmosphere and the Earth. 
The formula for the oscillation probabihty is 



P"^^ = - 4 E ki sin^($,,) + \ Jg sin(2$,,) 



j<k 



(3) 



where the CP-conserving coefficient R^l. and the CP- violating coefficient J^l are the real and 

imaginary parts, respectively, of UajUp^U^^Upk, and the relative phase ^ ^''^%L/'iE = 
1.27 (5m^^./eV2)(L/km)/(E/GeV), with 5mlj = m^—m^y The oscillation length, determined 
by setting = tt, is 

This same probability formula holds in vacuum or in matter at near-constant density, al- 
though the mixing elements and the effective masses differ in these two situations. 

After many oscillations, the coherence implied by the specific phases in eq. (3) is lost, due 
to magnification of experimental uncertainties in L/E or due to decoherence of the mass- 
eigenstate wave packets. For either reason, the result is an averaging which takes sm^{^kj) — ^ 
\ and sin(2<l>fcj) 0. This same averaging occurs also after even a few oscillations if the 
experimental uncertainties in L/E are sufficiently large. It is also important to note that 
the increase of A with E may lead to the suppression of oscillations at high energy, if the 
condition A » L is achieved. This suppression, together with matter effects, will become 
important in the discussion of through-going atmospheric neutrino events. 

Four-flavor mixing is described by six angles and three CP-violating phases. In addition 
there are three further phases for Majorana neutrinos; since these three phases do not 
enter into oscillation probabilities, we omit them. The six angles parametrize independent 
rotations in the six planes of four-dimensional space. For our purposes, it is useful to order 
these rotations as^ 

U — -R23(^Ts)-R24(e;i;i)-Rl4(e/ie)-Rl3(eee)-R34(^atm)-Rl2(^sun) ■ (5) 



^We note that the ordering in eq. (5) is the same as that in [15-17] when e^e and eee are set to 
zero, as is done in [15-17]. 
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Unitary U transforms from the mass basis (777.4, ttis, m2, mi) to the flavor basis (i/^, Ur, Vg, ^e)- 
In suggestive notation, the e's are small angles limited by the short-baseline (SBL) data, 
^sun and ^atm are the angles dominantly responsible for solar and atmospheric oscillations, 
respectively, and 9rs is a possibly large angle parametrizing the dominant mixing of the I'r 
and Us flavors. Explicitly, the Vt-J^s niixing resulting from E^.^{9rs) is 



:: 









cos O-rs — sin O-rs 

sin cos Ors 



(6) 



As shown in [18], the three phases may be assigned to the double-generation skipping 
rotations i?24 and -R13 and any one of the single-generation skipping rotations, in the following 
manner: equal and opposite phases are attached to the two non-diagonal elements of the 
rotation matrix. For the single-generation skipping complex rotation, we choose it!i4. Since 
the three angles of i?24, -R13, and it!i4 are small, this amounts to assigning an arbitrary phase 
to each of the sin(ej) ~ e/s, with to the right of the diagonal and to the left.^ The 
small-angle part of U is then = R2'i{^ij.n)Ru{^ixe)Ri3{^ee), which to order is 



V 























f ee 


-e* 











-e* 




-e* 

ee 





l_if|e |2 1 le 12 



(7) 



We note that with this parameterization the nonzero phases are associated exclusively with 
small angles, making the smallness of any observable CP-violation in the 2-1-2 scheme im- 
mediately evident. 

When the CP-violating phases are allowed to range from to tt, all angles may be 
restricted to the interval [0, 7r/2]. However, when the phases are neglected, the ^'s still range 

over [0,7r/2], but the e's now range over [— 7r/2,7r/2] (or over [0,7r]). 
The two large-angle mixings on the right in eq. (5) are given by 



^The small-angle expansion of cos(ej) is 1 
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U± — -R34(^atm)-Rl2(^sun) 



COS 6'atm 


sin 6'atm 








- sin 6'atm 


COS ^atm 














COS 6'sun 


sin 6'sun 








- sin 6lsun 


cos ^sun 



(8) 



y U U - Sm t/sun cos t/gun / 

This matrix independently mixes each of the two mass doublets in the 2+2 spectrum. U± 
approximates the full mixing matrix in the (z/^, z/+, z/_, u^) basis. The advantage of locating 
Ue to the left of U± is that in the full mixing matrix U, the angle ^atm appears only in the 
first two columns, and ^sun appears only in the last two columns. Consequently, atm/LBL 
amplitudes do not depend on ^gun, and solar amplitudes do not depend on ^atm- Of course, 
in any parameterization, the SBL amplitudes are insensitive to mixing within either mass 
doublet, and so depend on neither 6'atm nor on 6'sun- 

Recent global fits of the 2+2 model to solar and atmospheric data [15-17] have focused on 
the seven-parameter set {e^u^u, 9ts, dsun, ^atm, <^"^lsnd' '^"^sum '^"^atm}; neglecting the two small 
angles e^e, ^ee, and the three CP-violating phases.^ The investigation of the dependence of 
the sterile neutrino sum rule on the small angles (e's) in this paper suggests that neglect of 
these small angles, especially e^g, may not be warranted. 

III. SUM AND PRODUCT RULES 
A. Zero*'* order in e's 

Let us first discuss the oscillation probabilities in vacuum in the limit where the e's are 
set to zero. This limit results when {usIi'a) = = (ueWs), and {i'ii\i'2) = = (z/^|z/i). 

In the limit of vanishing e's, one can use eq. (8) to read off immediately that LBL/atm 
oscillations of the are zero and i/^ oscillates into pure u^; at the solar-scale, Ug 
oscillations are zero, and oscillates into pure u-] and there are no SBL oscillations. 

It proves useful to denote the amphtude of the CP-conserving oscillation at each 5w? 
scale (short-baseline/LSND, long-baseline/atmospheric, and solar) by [3] 



^In ref. [17] the angles e^e and ege are turned on, but only in the LSND part of the analysis. 
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2 4 
j=l fe=3 

(9) 

The disappearance amplitude is denoted by 

AaIj^P ^^^)=Y. ^A(i^/3 ^ i^a) = 4^ |C/;3,f |C/;3fe|2 ; (10) 
a^fi A 

here, A denotes the SBL, LBL/atm, or solar scale, and denotes the sum over the appro- 
priate mass states indicated explicitly in eq. (9). Similarly, the CP-conserving contribution 
to the probabihty at each scale is denoted by 

P^{T^a = AA(l^a ^ i^/?) Sin^ (^^^^j ■ (H) 

Some care is required in applying these contributions to oscillation data, since observables 
at any given scale will in general receive contributions from that scale and all shorter scales. 
Such is not the case with the block-diagonal mixing of eq. (8). 

Explicitly, the nonzero oscillation amplitudes for due to atmospheric-scale oscillations 

are 

Aa.tni{^H T^t) = Sin^(26'atm) COS^ d^s (12) 
^atm(i^/i T^s) = Sin^(26latm) Siu^ O^s (13) 
^atm(i^M ^ ^1^) = Sin2(2^atm) (14) 

while for i/g due to solar-scale oscillations they are 

^sun(i^e ^t) = Sin^(26'sun) siu^ Brs (15) 
^sun(^'e l^s) = Sin^(26'sun) COS^ 9rs (16) 
Aun(i^e ^ l^^) = Sin2(2^sun) (17) 

We note that matter effects cannot alter the texture of the off-diagonal elements of the 
mass-squared matrix in the flavor basis, because the matter potential is diagonal in this 
basis. Consequently, the block-diagonal structure of the diagonalizing matrix in eq. (8) 
is maintained in the presence of matter. This further implies that eqs. (12) to (16) are 
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unchanged in form by matter, although the angles (and mass-eigenvalues) assume different 
values. 

In solar matter, there is an essential nuance enriching the neutrino physics: The evolution 
of the neutrinos from the sun's center to the sun's surface is dominated by matter effects. 
The solar matter-density is not constant, and so the matter-dependent mixing-angles change 
continuously as the neutrinos transit the sun, possibly effecting non-adiabatic transitions 
among mass-eigenstates. However, for large ^sun, which holds for the LMA solution which 
we consider in this work (and for the QVO and VO solutions), the neutrino propagates 
adiabatically from the sun's center to the surface. This means that the neutrino emerges 
into vacuum with the combination of mass eigenstates unchanged from that determined 
at the sun's center. Moreover, solar neutrinos with energies above the solar resonance 
associated with Srrig^^ and below the atmospheric resonance associated with Sml^.^ will 
evolve adiabatically to emerge from the sun in a nearly pure 1^2 mass-eigenstate. The solar 
and atmospheric resonant energies in the 2-1-2 model in the zero e's approximation are [19] 



-.i? <^"^sun cos(2^ 

sun) 

'""^ 2{Acc-cos^{ers)ANc)' 



(18) 
and 



ji _ COs(2gatm) . 

Asm [Ursj^NC 

respectively. The vacuum angles and mass-squared differences are defined previously, and 
Acc = V^GpNg and A^c ^ \Acc are the effective contributions of the matter potential to 
the Hamiltonian in the flavor basis, written in terms of the electron number density. Putting 
in the values A^e(O) = 6.0 x lO^^cm"^ for the electron density at the center of the sun, 5ml^^ — 
4xlO-^eV^ and 5ml^^ = SxlQ-^eV^ one finds adiabatic evolution to near-pure V2 for large- 
angle solar mixing and energies in the range between — 4cos(2^sun)(l + sin^ 9rs)'^ MeV 
and E'^ni = 300cos(2^atm)(sin^ 6*,-^)^^ MeV. The solar neutrinos from the decay chain, 
measured in the SuperK and SNO experiments, lie within this energy range. 

The neutrinos arriving at earth from the sun are incoherent mass eigenstates.^ Thus, 



-"Even if the neutrinos exiting the sun bear coherent phase relationships, they decohere in transit 
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the density operator describing the decoherent ensemble of neutrinos arriving at earth from 
the sun is diagonal in the mass basis. In the adiabatic approximation, it is simply 

P^a.s = El^5n^.><^.|- (20) 
3 

Here, is the mixing matrix at the center of the sun where the solar neutrinos originate. 
Let us label the solar neutrino 'V©" to signify its ^sun solar history. The probability 
to measure neutrino flavor j3 at earth is then given by 

Psi^o - ^p) =< \p'\ >= E 1^51' l^&f ' (21) 

after applying eqs. (1) and (2). The Uq = V2 approximation^ consists of setting |^7^ P equal 
to 5j2, yielding 

PvQ-^vn = \Up2\'^ [uq = 1/2, adiabatic] (22) 

In the absence of e's, we have from eqs. (6), (8), and (22), that 

1/2 = cos 6'sun(sin Orsl^T + COS 9rsJ^s) " siu 6'sun J^e ■ (23) 

^Prom this equation, we may read off the values of UJ2 to obtain the oscillation amplitudes 
for solar neutrinos arriving at the earth in the Vq = 1/2 approximation: 

cos'(^,„n) sin'^^. (24) 

COS^ (6'sun) COS^ 6rs (25) 
C0s2(^sun) (26) 

In these formulas, the angles are truly vacuum angles. 



to Earth if drn^^^ Z 10-^°eV^ due to the many oscillation lengths contained in the one A.U. path 
length. 

^In our numerical work we will go beyond the uq = 1/2 approximation. Nevertheless, uq = U2 is 
a good approximation offering simple results. Numerically, we find that |C/^P = 90%, 98%, and 
99% for El, = 5, 10, and 15 MeV, respectively, for zero e's, and with little change for nonzero e's. 



^sun(i^0 ^t) — 
^sun(i^0 = 
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Thus, unitarity in the context of the 2+2 mass spectrum has led one to a sum rule [9] 
and a product rule at zero*'* order in e: 



[^(^0 - 




+ 

sun 
















atm 



(COS^ 9rs)v + (Sin^ 9rs)E^'^ 



(27) 



and 



X 



P(iy„ 



(cot^ 9rs)v X (tan^ O^g) b ^ 1 



(28) 



atm 



where the subscripts V and E signify "vacuum" and "earth- matter" , and the arrows hold 
in the limit of negligible earth-matter effects. In the figures to follow and the discussion 
thereof we will refer to the ratio terms in eqs (27) and (28) as i?sun and -Ratm, respectively. 

We emphasize that the sum and product rules are not required by any underlying symme- 
try or principle. Rather, they are accidents of the block-diagonal structure of eq. (8), which 
results when the small angles arc neglected. The values on the right-hand sides of these two 
rules, eqs. (27) and (28), will differ from unity when the small mixing angles are included, 
even if matter-effects are absent. Furthermore, although their values are intimately related 
at zero*'* order in the e's, they are not so simply related at higher order in e's. 

The purpose of this paper is to evaluate these sum rules, including the small angles 
neglected in previous work, and including possible earth-matter effects. In the next section, 
we calculate oscillation probabihties to order e^, to find the order corrections to the sum 
(27) and product (28) rules. In section V we numerically evaluate the sum and product 
rules without approximation. Readers interested only in the answers may jump over the 
remaining formalism to find the results presented in section V. 

B. Order e and corrections 



To order e^, the full mixing matrix in the physical fiavor-basis (i/^, i/,-, i/g, v^) is the product 



/ 



U 



10 

cos^^o sinO^s 



— sin^^s cos^i-s 







(29) 
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where Ue and U± are given in eqs. (7) and (8). This mixing matrix determines all of the 
oscillation amplitudes to C(e^), and so determines the 0{e) and O(e^) modifications to 
the sum rules. Here we give the individual flavor-changing amplitudes for SBL, solar, and 
atmospheric neutrinos to C(e^). Wc begin with the SBL amplitudes, and summarize the 
existing experimental constraints on these amplitudes. 

In our notation, the SBL oscillation amplitudes to order |ep are 



AsBLil^e -^^4)=^ [le^er + keel'] (30) 

>lsBL(i^M ^ = 4 [|e^e|' + Iwl'] (31) 

^sbl(«^^ ^ z^e) = 4|e^er (32) 

^sbl(z^m ^r) = 4|e^^|' sin^ O^s (33) 

^SBL(i^M ^ ^s) = 4|e^^|2 COS^ 0rs (34) 

^SBL(«^e I^t) = 4|eeeP COS^ 6rs (35) 

^SBL(i^e ^s) = 4|eee|'sin^6'rs. (36) 



These amplitudes, and so the values of the small angles See, C/ze and 6^^, are bounded from 
above by the experimental limits on i/^ and disappearance in vacuum, and by atmospheric 
neutrino oscillation data. The positive result of LSND bounds e^e from below, but this 
constraint is not significant for present purposes. For the allowed LSND region ^rnggL ~ 
1.0 to 0.2 eV^, the BUGEY disappearance experiment [21] provides the 90 % C.L. bound^ 
|ylgBL(^e = keep + k^eP ^ 0.01. The CDHS [22] z/^ (z/^) disappearance experiment 

bounds the amplitude \A^^i^{yi^ —>■ i/^) — |e;:i//P+ |e^ep < 0.2 for Sm^^i^ ^ 0.3eV^. In fact, a 
more stringent bound on AsBh{j^ij. ^i/) results from atmospheric neutrino data (a nonzero 
value for this amplitude is incompatible with maximal mixing at the ^m^^m scale). A 
fit to atmospheric data [15] results in ^sbl(«^/. i^//) < 0.48(0.64) with 90% (99%) C.L., 



^The KARMEN experiment provides a tighter bound than the BUGEY experiment for Sm^gj^^ > 
0.2eV^, reaching |Asbl(^'// — i^e) ~ 0-7 x 10~^ at (^rriLSND ~ leV^. However, atmospheric ex- 
periments average over the SBL contribution, and so are not sensitive to the value of (^J^lsnd- 
Accordingly, the appropriate bound to use is the more Uberal BUGEY bound, inferred at 
5mls^^ ~ 0.2eV2. 

12 



which translates into |e^^p + |e^eP < 0.12(0.16). We note that the CHOOZ hmit on u^- 
disappearance at the atmosphere scale is of order (e^g, egg)^ ^ 10~^ in the context of the 
2+2 model, and so is not of interest. 

To summarize these constraints, the 90% CL. bounds which we will use in our numerical 
evaluation of the sum rules are: (i) |eeep + |e^eP < 0.01, and (ii) |e^^P < 0.12. Note that 
these bounds allow egg and e^g to be as large as 0.10, and allow e^^ to be as large as 0.35. 

Before ending this discussion of the SBL amplitudes, we note in passing a new product 
rule for SBL amplitudes. Emerging from eqs. (33)-(36) is 



SBL 



P(iy„ 



P(u„ 



(37) 



SBL 



exact to order e^, at least. 

Next we turn to the amplitudes for solar neutrino oscillations. We employ again the 
adiabatic approximation valid for large solar-mixing solutions, and simplify the discussion 
here with the Uq = 1^2 approximation. To O(e^), the expansion of 1/2 in flavor states is 



1/2 >= 



(e^^ cos 9s 



e^e sm I 



+ (sin6'„[cos6lsun(l - i|e 



+ (cos Ots [cos 



2 I MA^I 

i|e I 



cos6'„sin6'suneee) \ l^T > 



(38) 



} + sm ysune^^e^tej - cos Urs sm ysunCe 

^) + sin 6'sune;;^e,.e] + sin 6'^5 sin 6'sunegg) \i's > 

sin ^sun (1 2 I I 2 I ^/"^ I ) I ■ 

For solar neutrinos arriving at the "day" hemisphere of the earth, all angles assume vacuum 
values. This result generalizes eqn. (23) to nonzero e's. ^Prom this, one can easily calculate 
the first term in the sum rule (27), 

>(^0 



P{v^ 





< 


V2 > 


2 


1 - 




< Ve 


V2 > 


2 



(39) 



as a function of the large and small angles. Similarly, the first factor in the product rule 
(28), 



< l'sW2 > 



|2 

I2 ' 



(40) 



I < yT\^2 > 
can be readily calculated. 

Finally, we turn to the oscillation amplitudes for the atmospheric neutrinos. The second 
terms in the sum and product rules, namely. 
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and 



-Plbl(^'m ^t) + PsB\.{yii 



(42) 



respectively, are given by inputting the appropriate amplitudes. In the atmospheric data, 
the measurement process averages over oscillation scales small relative to the Earth's radius. 
Hence it is correct and necessary to include contributions from the LBL length-scale and 
smaller, which here includes the oscillation- averaged short baseline amplitudes. One notes 
that the SBL amplitudes, given in eqs. (30)- (36), contribute to the sum rules at order but 
not order e. The long baseline amplitudes to order are: 



AhBhii'ti i^s) = sin^26'atm [sin^ 9rs{l - |e^eP - leeeP) - le^/i^] 

- sin 46'atm[^ sin 29rsRe{e^f,) + i?e(e^^e* J sin^ O^s] (43) 

^LBL(i^M ^ ^r) = Sin^ 26latm [cOS^ 6'rs(l " le/^e^ " keeH - | 

+ sin4^atm[^sin2^^,i?e(e^^) - Re{e^^el^) cos" Or s] (44) 

^LBhil^H ^ i^e) = - sin 26'atm [{\^ne? " \^ee?) Sin 26'atm + '2Re{e*^eee) COS 26'atm] (45) 

Ai^Bd^t, ^ ^yi) = sin^ 2eatm [1 - Sje^el' - 2|e^J'] - 2 sin4eatmi?e(e^^e;j (46) 

With eqs. (39)- (42) as our guide, it is not difficult to write out the explicit analytic expres- 
sions for the sum and product rules. It is also not especially illuminating to do so. One 
finding is that the order e and corrections are different for the sum and product rules. 
Thus these two rules, containing the same information in zero*'^ order, contain different 
information when the small angles are included. We remind the reader that atmospheric 
oscillations occur in the earth, and so the mixing angles that enter eqs. (41) and (42) are 
matter rather than vacuum angles. 



IV. MATTER EFFECTS 



As has already been discussed, the effect of solar matter on the emerging solar neutrinos 
is very significant. Turning to earth-matter, we find in our numerical work that its effects 
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are small at low neutrino energies ~ 1 GeV, but large at high energies. Thus at low energy, 
the neutrino plots we show are little changed for the atmospheric antineutrino flux. Among 
the energy bins we consider, the largest difference for neutrino vs. antineutrino occurs in the 
1.5 to 30 GeV bin. At still higher energies, wc find the main effect of matter is a suppression 
of oscillation, common to both neutrinos and antineutrinos, and an interesting resonance 
at the Srri^ scale, in the i/^ — channel [19]. This resonance is independent of the sign of 
the matter potential for large £'5A;vc/<^"^atm> common to both neutrinos 

and antineutrinos. Thus, we find that overall the sum rule results we show for neutrinos are 
little altered for antineutrinos. 

The relevant part of the neutrino Hamiltonian in the fiavor basis is 

H^F = Uvi^Ul + A,. (47) 

The matter-induced potentials are A = ^^/2Gf diag{—Nn, —Nn, 0, 2Nf, — A^„) in the 
(z/^, Ut-, Us, Ve) fiavor-basis; N^. and Nn are the electron and neutron densities. For antineu- 
trinos, the sign of A is reversed. Since an overall phase is not measurable, it is useful to 
translate A by -|-A^nl and use the relative potentials A — -\/2G'i;' diag(0, 0, \Nn, Ng). With 
Nn, which holds in the earth and in the sun, one has A= (0, 0, ^jvc, ^cc): with Aqc — 
V2GFNe ^ 2Anc, as presented earher. Numerically, Acc = 0.80 x 10-'^^{Ne/NAcm-^) eV. 
Electron densities in the earth's mantle and core are {N(.)m ~ 1.6iVyi/cm'^ and {Ne)c ~ 
6 A^^/cm^. 

Diagonahzation of (47) to 

H^ai.,)-UlH^^U, (48) 

is done numerically in our work. It yields the mixing- matrix in matter {11^) and the mass- 
squared eigenvalues in matter (the diagonal elements of -f^(diag))- The matter contribution 
to the Hamiltonian can significantly alter the masses and mixing angles, compared to their 
vacuum values. 

Insight into the multi-resonance possibilities among four neutrino fiavors may be found 

by using the approach of [19]. The idea is to find a neutrino basis such that the effective 
Hamiltonian matrix, including matter potentials, nearly decouples into a resonant 2x2 
sub-block embedded in the rest. Decoupling may occur when ESA is matched to just one 
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of a hierarchy of 5m^ values. A two-neutrino analysis may then be applied to the decoupled 
2x2 sub-block. 

Consider the 2x2 effective Hamiltonian (hermitian) matrix 



H 



^22 ^21 
^21 ^11 y 

The rotation angle which diagonalizes H is given by 



(49) 



tan(2^M) = , ^'^'ij . (50) 
'i22 — mi 

The oscillation amphtude is sin^(26'M)- The eigenvalue difference is 

Sh = ^J{h22-hny + 4\h2l\^ = 2E5ml, , (51) 

where the second equality defines the effective mass-squared difference Sml^ in matter. 

It often happens that the denominator /i22 — hu varies from positive through zero to 
a large negative value as energy or matter density are varied. When this is so, 9i\4 varies 
from its vacuum value 6v, through resonance and maximal mixing at 7r/4, ultimately to 
nearly 7r/2. The resonance with 9m — 7r/4 and maximal oscillation amplitude sin^(2^M) = 1 
occurs when /i22 = hn. The resonance width, defined by the half- maximum amplitude 
sin^(2^M) = |, i-e. tan^(2^M) = 1, is given by |/i22 - hn\ = 2|/i2i|- 

For comparison purposes, it is useful to recall the exact two-flavor results. The oscillation 
amplitudes in matter and vacuum are related by 

where ^ is defined by 

e ^ (cos(2^^) - = cos^(2^v') (l -^)\, (53) 

Here, SA — Ai— A2 is the difference in matter potentials ordered opposite to the difference 
in vacuum mass-squares, Sm^, and the resonant energy in the two-flavor system is 

Mass-squared differences in vacuum and matter are related by 
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The oscillation length is changed from its vacuum value Xy — 2.48 {E /GeV){eV^ / Sm^) km 
to 



Note that in the two-flavor analysis, a near maximal vacuum angle forces the resonant energy 
toward zero (eq. (54), and further, necessarily implies suppression of the amplitude (eq. (52)) 
and contraction of the oscillation length (eq. (56)). The atmospheric vacuum mixing-angle 
is nearly maximal. 

Note also the trend as the energy E is increased: ^ varies from cos^(26'y) at low energy, to 
zero at resonance, to a value increasing as E^ above resonance. At the resonant energy, the 
oscillation amplitude sin^ 29m attains its maximum, unity, the mass-squared difference at- 
tains its minimum, {5m\j)R = SmF' sin(2^^y), and the oscillation length is \r = Xy/ sin(2^y). 
For small vacuum angles, these changes are large. With large mixing angles, the changes 
are not dramatic; in addition, the resonant energy is very small and the resonance is broad. 
The sign of 5m^/ 5 A determines whether the resonances occur in the neutrino or antineutrino 
channel. For 9v < 45° (the "light side"), the neutrino (anti- neutrino) channel is resonant 
for 5A as defined and Sm^ of same (opposite) sign. Equivalently, resonant oscillations occur 
in the neutrino channel when Er as defined in (54) is positive, and in the anti-neutrino 
channel when Er as defined is negative. As can be seen from eq. (52), large E suppression 
of oscillations is the same for neutrino and antineutrino. 

For neutrino energies well above the resonant value, the oscillation amplitude is sup- 
pressed as and the oscillation length is contracted toward its energy-independent 
asymptotic value Am = 27r/|5A|. Numerically, this asymptotic oscillation length is Am = 
1.3 {10~^^eV /\SA\) X 10^ km, which is of order of the Earth's diameter for the values 
of Ar^c in earth matter. Before approaching its asymptotic value, the oscillation length 
reaches a maximum value of Amax = 27r /\5A\ sin 29v- Thus, with just two flavors the main 
effect of matter at large energy is to shorten oscillations relative to their vacuum values, but 
especially to suppress oscillations as 9m is pushed toward its asymptotic value of 7r/2. 

In contrast, with four flavors, the six rotations and additional matter potential greatly 




Ay 




Ay 



(56) 
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enrich the matter-dependent oscillations. Diagonalizing the effective 2x2 sub-blocks gives 
results qualitatively different from diagonalizing an exact 2x2 matrix in a true flavor basis. 
We find, for example, that in the energy range 5ml^.^/A]^c -C <C 5m1g^Y)/^NC the 
atmospheric osciUation probability for both and Ufj, may be significantly enhanced by 
matter, when the small vacuum angles satisfy certain relations. This surprising result is 
contrary to the suppression one expects from studying a pure two-flavor model. We reserve 
the detailed analysis of particular oscillation-channels for a future publication [23], since 
the focus of this (already long) paper is the sum rule, which involves ratios of oscillation 
channels. 



V. RESULTS 



A. Zero*'' Order 



We begin our presentation of results with a plot (Fig. 1) of the zero*'* order sum rule, and 
the exclusion boxes that result when all small angles are set to zero [15]. The axes labels 
are 



R: 



atm 



and 



Rfi 



(57) 



atm 







(58) 



The 90% exclusions are 0.17 for the sterile contribution to the atmospheric data, and 0.45 for 
the sterile contribution to the solar data. The 99% exclusions are 0.26 and 0.75, respectively. 
A similar value of R^nn < 0.7 at 3 u is given in [14]). We have checked that the effect of earth 
matter on the sum and product rules is negligible (less than 1%) when the small angles are 
zero. As a consequence, the zero*'* order plot of Fig. 1 stands as a prediction for oscillation 
data over the entire relevant range of atmospheric neutrino energies, 0.5 GeV to 500 GeV, 
when small angles are neglected. In the context of eqs. (27) and (28), this means that the 
change in O^-s due to earth-matter is negligible in the whole [0.5, 500] GeV energy region 
when e's are set to zero. 
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As one sees in Fig. 1, the overt sterile of the 2+2 sum rule conflicts with the sterile 
exclusion bounds coming from the solar and atmospheric data when the three small angles 
of the 2+2 model are neglected. The 99% exclusion box just touches the sum-rule line at 
a single point, where tan^ 9rs = -Ratm/-Rsun = 0.26/0.75, or 9rs = 30°. The question arises 
whether inclusion of these small angles can sufficiently scatter the sum rule and weaken the 
exclusion boxes to make the 2+2 model viable. Re-calculating the exclusion boxes with 
nonzero small angles is a formidable task beyond the scope of this paper. We note, however, 
that a global fit with the largest of the small angles (e^^ in our notation) included has been 
performed. The consequence is an expanded exclusion box for the value of cos^ 6^^ cos^ e^^ 
derived from atmospheric neutrinos. However this latter quantity is not directly related to 
-Ratm for e^^ 7^ 0, and so we continue to show just the restricted fit (e's = 0) in the figures 
to follow. Nevertheless, the trend is clear and expected: adding the small angles allows a 
larger sterile neutrino component in the global data. 

B. All Orders 

We next show that the sum rule is significantly broadened when small angles are included. 

We display our numerical results, which include the effects of the nonzero small- angles 
and matter, in scatter plots in the plane labeled by the two terms of the sum rule or product 
rule. Each scatter point is determined by a random choice of the three small angles within 
their allowed regions, and a random choice of 9ts within the interval [0, |] . In the numerical 
work, we use the full rotation matrices for the small angles, rather than the small-e expansion 
presented earlier. We allow each e to range over — exe < e < cxb, where the set of exB are 
the experimental bounds derived earlier in this paper (either 0.10 or 0.35). We remind the 
reader that we must include negative values of e to (partially) atone for our neglect of the CP- 
violating phases independently associated with each e. We do not take on the extra burden 
of calculating with complex e's, as this would double the number of small-angle parameters, 
from three to six. For the atmospheric data sample, we restrict ourselves to the angular bin 
that is most up-going (—1 < cos^^ < —0.8). The most up-going bin is chosen because events 
in this bin have the longest baseline and so have enhanced oscillation probabilities, and the 
best experimental test of the sterile/ active neutrino ratio in atmospheric data involves the 
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matter-effect. 

We simulate the low-energy atmospheric data set by averaging the incident neutrino 
energy over a specific energy range, and by averaging the zenith angle over — 1 < cos^^ < 
—0.8, for each scatter point. Four specified energy ranges arc chosen. They arc 0.5 to 
1.5 GeV, to simulate the contained events, 1.5 to 30 GeV, to simulate the partially contained 
events, 30 to 500 GeV, to simulate the full range of through-going events, and 50 to 150 GeV, 
to display the "typical" energy of through-going events. Each point displayed in the scatter 
plot is constructed as the mean value of 500 events, each a product of 50 randomly chosen 
energy values times 10 randomly chosen zenith-angle values. To judge the stability of this 
averaging, we repeated some trials with 500 energy values times 100 zenith-angle values. 
The results differed by less than 1%. 

For the solar data, we average over the energy range 5 to 15 MeV, by choosing 50 random 
points within this range. 

The following numerical values of the solar LMA ^ and atmospheric best fits [15] are 
taken as fixed: 

Sml^^ = 3.7 X 10"^ eV^ 
tan2e,„n = 0.37 (i.e. ^^un = 31°) 
tan' ^atm = 0.66 (i.e. ^^tm = 39°) 

5m^,^ - 2.4 X 10-3 eV^ (59) 

The allowed range for Smj^g^jy is 1 to 0.2 eV'. However, neither the atmospheric nor the 
solar data are sensitive to the exact value of Smlg^j), so this parameter does not enter 
our analysis. It is instructive to compare the vacuum oscillation lengths with the Earth's 
diameter D^, for each of the fixed mass scales. For the solar scale, we have 

MS<J-'^sn^{ji^)[ '-'-;^y ); (60) 

for the atmospheric scale, we have 

V(.™L)^o....(^)(Miil£^). (ax) 



^After publication of the SNO NC data the LMA solution is selected at 99 % C.L. [24] 
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and for the short-baseline scale we have 



Ay(5m2gND) = 2.0x lO-^A 



( 



E 



) 



( 



eV^ 



) 



(62) 



e 



lOGeV 



As explained in the previous section, in earth these oscillation lengths are expanded near 
a resonance, and become constant well above any resonance. Nevertheless, the inferences 
are that the solar scale barely contributes to atmospheric data, and then only at the lowest 
energies few GeV); the SBL scale is averaged in the atmospheric data until E ~ TeV; 
and the atmospheric scale is well-tuned to the size of the earth (which is why the dramatic 
zenith-angle dependence was so readily discovered), and so must be handled with care. In 
our numerical work this has been done. Fast oscillations (e.g. oscillations driven by 5^lsnd) 
are averaged over by setting large relative phases in the oscillation probabilities to zero by 
hand. The description of this procedure is given in Appendix IX. 

Scatter plots for the sum rule resulting from these central values are displayed in Figs. 
2-5. The number of points in each scatter plot, and in each of those to follow, is 4,000. This 
number is chosen as a balance between computer time and the density of the final scatter 
plot. Also shown in these figures as a guide to the eye are the 90% and 99% exclusion boxes 
that result when all three small angles are set to zero. The weakening of the sum rule when 
small angles and matter effects are included in the oscillation physics is evident. At high 
energies, the sum rule has so relaxed that a large fraction of the allowed scatter points even 
lie within the allowed region of the conservative, zero e, exclusion boxes. 

To allow the reader to assess the relative significance of matter-effects in earth, we show 
the same plots with earth matter omitted in the bottom windows. It is seen that earth-matter 
effects are not significant at low energies but become important with increasing energy. Near 
a resonance, earth-matter will affect neutrinos and antineutinos quite differently. Above a 
resonance, earth-matter will have the same effect on neutrinos and antineutrinos. Whenever 
earth-matter effects are evident, we have also run the same figure in the antineutrino channel 
to determine whether the matter-effect is different or the same for this channel. We discuss 
the antineutrino channel in section VE. 

The earth-matter effects on the atmospheric ratio i?atm contributing to the sum rule (27) 
are evident, but still much less dramatic than the matter effects on individual atmospheric 
oscillation probabilities. In particular, the sum rule has some built-in stability against earth- 
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matter effects on the oscillation. If the atmospheric oscillation were pure ^ Vs-, then 
the atmospheric ratio appearing in (27) is one by definition, independent of any matter 
effects. If, at the other extreme, the atmospheric oscillation were pure v^, then the 

atmospheric ratio in (27) is zero by definition, again independent of any matter effects. 
The intermediate cases will show some intermediate but not large matter effect. The ratios 
defined for the sum rule tend to cancel individual variations in P(i^^ — > fg) ^-nd P^i^fi i't)- 
In addition, the SBL contributions to the oscillation amplitudes, arising from the large 
(5mLSND5 ^ot matter suppressed, and so tend to stabilize the sum rule. One may expect 
matter effects to be more pronounced in the product rule (28), in that the stability argued 
here is less applicable for a product than for a sum, and less applicable for the ratios defined 
for the product rule compared to those of the sum rule. 

One remarkable feature of Figs. 2 to 5 is the energy dependence of the sum rule. A 
roughly diagonal band in the plots at low energy (^ 30 GeV) turns into a butterfly at 
high energy (^ 30 GeV). This is a result of the energy-dependent matter-effects on the 
oscillation amplitude and length, and of suppression occuring when oscillation lengths are 
large compared to the Earth's diameter. 

While for low energies the zero*'* order sum rule provides a good approximation to the 
2+2 scheme with non-vanishing e's, i.e. -Ratm ~ sin^^^^^ ~ 1 — Rsmu, at high energies the 
dependence on 9rs is quite different. This is explainable. At low energy the atmospheric 
oscillation is dominated by the LBL amplitude (43), leading to i?atm ~ sin^^^^. However, 
at high energy, the LBL amplitude is matter-suppressed at moderate to large 9ts because 
then Amc participates on the 5m1^^ scale; while for small Orsi the i^^ — > Vg oscillations occur 
dominantly via the matter-independent SBL scale, with amplitude given by 4 |e^^p cos^ Ots- 
We note the transition from sin^ O^-g to cos^ dominance as the energy grows from low to 
high. It is also possible that the changing oscillation length plays a role in the high-energy 
suppression of the LBL amplitude. As the energy increases, the wavelength grows first lin- 
early with energy, then reaches a maximum and finally approaches its energy-independent 
asymptotic value. If the wavelength is long relative to the earth's diameter, then an exper- 
iment samples only a small fraction of a single oscillation cycle. For example, taking the 
vacuum oscillation length of Ay((5m^^jjj) ~ 10 -D® (£^,^/100GeV) as a guide, one gets a sup- 
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pression of sin^(7r/10) = 0.1 for E,^ ~ 100 GeV; this may be compared to the SBL amphtude 
4|e^^pcos^^^5, which may be as large as 0.48. To summarize this discussion, the atmo- 
spheric oscillation at high energy is dominated by the SBL contribution (34) proportional to 
cos^ 6rs- Therefore, with 6rs ~ 7r/2, the sterile neutrino can hide from both the atmospheric 
through-going data and the solar data! For through-going events {E^, above 30 GeV), the 
figures show that arbitrarily low sums seem possible. This may explain the good fits found 
for the pure Vg atmospheric model found in [15,25]. 

One moral to be drawn here is that the SuperK through- going {E^, typically ~ 100 GeV) 
analysis with a single 5m^ ~ lO^^eV^ does not apply to the 2+2 model. With only a LBL 
contribution and no SBL contribution, i^atm is necessarily proportional to sin^ Ots] then non- 
observation of i/g-signatures will inevitably be interpreted as a small value for 9rs and an 
absence of Vg in the atmospheric sector of the theory. 

We have analyzed the effects on the sum rule of variations in the solar and atmospheric 
mixing angles, and in the three 5m^'s. None of these variations had dramatic effects. The 
largest changes resulted from variations in 5ml^^ and ^sun, but especially in ^atm- As the 
atmospheric angle decreases, the deviation from the sum rule increases. 

C. Individual e's 

An interesting question is what are the relative weights of each small angle in altering 
the sum rule result. To answer this, in Figs. 6 to 9 we present the dependence of the sum 
rule on the individual e's. A comparison shows that the effect of non-zero Cee on the sum 
rule is small, and that the strong deviations in the sum rule at high energies are induced by 
the non- vanishing e^^ and e^e- Especially interesting is the influence of e^e; since this angle 
is set to zero in the global analyses of [15-17]. The results here suggest that at least the 
small mixing angles e^^ and e^e must be consistently retained in the global analysis, and 
therefore casts some doubt on recent claimed exclusions of the 2-1-2 model. 
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D. Product Rule 



In Fig. 10 we show the product rule for one selected energy range, 50 GeV < E^, < 
150 GeV. Here the axes labels are 



It is obvious that the deviation of the product rule from the diagonal line of the zero order 
result is even more pronounced than the deviation of the sum rule. We have argued in favor 
of this in an earlier section. 



Oscillation probabilities for atmospheric antineutrinos arc found by reversing the sign of 
the earth-matter potentials. When the e's are neglected, matter effects on the atmospheric 
ratios are negligible, and so the neutrino and antineutrino contributions to the sum rule are 
virtually identical. With nonzero e's, differences between antineutrino and neutrino may 
appear. Generally, we find that the antineutrino sum rule differs little from the neutrino 
sum rule, even with nonzero e's. None of the conclusions of this paper are affected by the 
small differences between atmospheric neutrino and antineutrino channels. 

The largest difference in the sum rule occurs for the energy region 1.5 to 30 GeV, which 
contains matter resonances associated with the 5m1^^ scale. In Fig. 11 we show the sum 
rule for the antineutrino channel in this energy region. This figure is to be compared to 
Fig. 3 for the neutrino channel. Larger differences between neutrino and antineutrino are 
found in the individual probabilities in this same energy region (not shown here). In the 
lower energy range 0.5 to 1.5 GeV, differences are not evident. At high energies above the 
resonance region 30 GeV), matter affects both channels nearly identically. 




(63) 



and 




(64) 



E. Atmospheric Antineutrinos 
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VI. SUMMARY AND CONCLUSIONS 



In summary, we have investigated the vahdity of the sum rules (27) and (28) for the sterile 
neutrino, when the three small-angles in the general 4x4 mixing matrix are included, and 
when matter effects are included. To do so, we have reduced flavor-evolution calculations 
for solar and atmospheric neutrinos to numerical multiplication and diagonalization of 4 x 4 
matrices. The inputs are the vacuum mixing matrix Uy, the vacuum mass-squared (or mass- 
squared difference) matrix My, and the electron and neutron densities for the solar core, 
earth mantle, and earth core. The output from eq. (48) are the energy eigenvalues H'^ and 
mixing matrices Uf^, k = S, M, C, in the solar core and earth mantle and core, respectively. 

Wc find that the zero*'' order sum rule offers a good approximation to the atmospheric 
data at low neutrino energies, but isn't valid at high energies. At high energies, the long- 
baseline amplitude is very matter-dependent, and the averaged short-baseline amplitude 
makes a significant contribution, even dominating for certain values of the mixing angles. 
Very small values for the corrected sum rule become possible. This means that the sterile 
neutrino of the 2+2 model can remain reasonably hidden from both solar and atmospheric 
neutrino oscillation data. We also find that both small angles e^^ and e^g make significant 
contributions to amplitudes when matter effects are included. While e^^ has been included 
in recent combined fits to solar and atmospheric neutrinos [15-17], the influence of a non- 
vanishing e^e has not yet been investigated. This weakens the case against the 2+2 model 
and the sterile neutrino. 

We noted earlier that the important SBL amplitude, dominant in the atmospheric sector 
at high energies for some parameter range of the 2+2 model, is not included in the two 
angle, one 5m^ fits performed by SuperK. This seemingly invalidates any comparison of the 
SuperK analysis to the sterile neutrino of the 2+2 model. 

Related but distinct from the sum rule is a product rule which we introduce. The product 
rule experiences even more pronounced deviations from zero*'* order expectations due to non- 
vanishing e's and to matter. The variables of the product rule are more difficult to extract 
from data than are the variables of the sum rule. 
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VIII. APPENDIX A: INCLUSION OF EARTH-MATTER EFFECTS 



In this Appendix we discuss some details of the earth-matter effects, and their inclusion 
in our calculation of the sum rules. 



A. Atmospheric Neutrinos 

Neutrinos originating in the atmosphere traverse a chord of the earth before measure- 
ment. Neutrinos which emerge from the earth at zenith angle 9 greater than 33° traverse just 
the mantle. Neutrinos which emerge from the earth at zenith angle less than 33° traverse the 
mantle, core, and more mantle, in a fashion nearly symmetric about the midpoint. We take 
the earth core to have near-constant density N^. = Nn = 6iV^/cm^ out to Rq = 3493 km, 
and the mantle to have near-constant density = = 1.6A^yi/cm^ out to the Earth's 
surface at — 6371 km. When the mantle and core are approximated as constant-density 
layers, it is straightforward to write down an analytic solution for flavor propagation of 
atmospheric neutrinos through the earth. 

To obtain the analytic solution, one notes that flavor states are continuous across matter 
discontinuities, whereas mass states propagate unmixed (i.e. diagonalize the Hamiltonian) 
within the constant-density layers. Thus, the analytic solution is a product of bases-changing 
matrices. Starting with an atmospheric Ua, the final flavor state emerging from the earth is 

X < uj; M\ e"*^^''^ M >< uj; M|i/„ > . (65) 
As usual, repeated indices are summed. Inputting eqs. (1) and (2) into (65), one gets 

\M0) >= UliO) > , (66) 
with the unitary evolution matrix for the Earth given by 



-2iHcrc rrt 
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The propagation matrices e"*^'"'' are diagonal, with elements determined by replacing the 
Hamiltonian i7„ with its eigenvalues. These eigenvalues, and the mixing-matrices, are ob- 
tained by diagonalizing (numerically) the flavor-space Hamiltonian (47). 

Any matrix proportional to the identity matrix may be subtracted from any of the i7's, 
since this just changes the unmeasurable overall phase of >■ 

The 9 dependence on the r.h.s. of eq. (67) is imphcit in the values for the lengths tm and 
rc- For a neutrino direction with zenith angle 9 < sm''^{Rc/R®) — 33°, half of the transit 
distance through the core is given by 

rc = ^Rl-Rl siu^9, (68) 

and each of the two transits through the mantle has a length given by 

Tm = -Re cos 9 -rc- (69) 

For 9 > 33°, the path is purely in the mantle, so = and the chord length is 2rM — 
2i?0 cos^. 

For atmospheric neutrinos, we are especially interested in the probabilities 

P,^f,^\<Ufs\U'^\u,>\'^\Uf^\' (70) 

and 

P,^^^l-\<u,\U'^\u,>\'^J2\Up,\'- (71) 
We use this final equality as a check on our numerical work. 

B. Solar Neutrinos, Day-Night Differences 

For solar neutrinos arriving during the daytime, cq. (21) applies as it is. For neutrinos 
arriving at night, further flavor evolution ("z/g regeneration") may occur in the earth-matter. 
The evolution equation (66) and its adjoint are used to calculate possible earth regeneration 
of the Ve component in the solar neutrino flux. The density operator for the solar neutrino 
ensemble in the flavor basis is obtained from eq. (20) via the change of basis eq. (2) and its 
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adjoint in vacuum. Then, the flavor states are evolved according to eq. (66) and its adjoint. 
The result is a density matrix for the flavors emerging from the earth, given by 

pf^Jor](0)-UEUvDsUlul,, (72) 

where the weights for the density matrix are contained in 

Ds^die.g{\U!,\',...,\Ui\'). (73) 

The final result of interest is 

P^+^(^e-^/?) = (pffl:v^])/3/3. (74) 

In our numerical work, we do not pursue earth regeneration of solar neutrinos because the 
effect is known to be small. In addition, the effect is not present in the daytime data. 

IX. APPENDIX B: IMPLEMENTING L/E RESOLUTION 

Experimental reconstruction of the neutrino energy E and pathlength L is limited by 
information loss when the neutrino undergoes CC scattering, and by experimental resolution. 
Such smearing in the data averages out the interferences among the shorter-wavelength 
oscillations. Also, transit of path lengths much longer than the oscillation length leads to 
decoherence of the mass-eigenstate wave packets, again removing the interference terms. We 
may implement interference loss or averaging as follows: 
For 6 < 33°, one has, from eq. (70), via eqs. (65) and (67), 

where Umc — t^jL Uc, there is no sum on /3 and and the phase governing the interferences 
is 

^l,k,j;s,q,p) = (/)(Z;s) + 0(A;;g) + 0(j;p) 

= (i/f - i^f ) TM + {H^' - O (2rc) + {Hf-Hf)rM. (76) 

For d > 33°, the result is much simpler: 
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P,^p = e-'^^-''^UM;pj Ul,^ Um;,, Ul^^p ; (77) 
again with no sum on (5 and /x, and the phase given by 

= {Hf - H^) {2R^cos9) . (78) 

If the experimental resolution and/or reconstruction of neutrino L/E is n%, then a phase 
in excess of ~ ^ tt will be smeared sufficiently that e~'* effectively averages to zero. Thus 
in numerical work, one may set to zero contributions from values of {I, k, j; s, q, p} in eq. (76) 
and {j]p} in eq. (78) yielding a phase in excess of, say, 10 tt. In this way, all sub-dominant 
as well as dominant contributions to the oscillation result are included. In particular, phases 
proportional to the LSND mass-gap may be safely set to zero. 

In our work, we explicitly set the phases proportional to the LSND mass-gap to zero. 
The other phases, proportional to Srn^^^ or Snig^^, are kept, but averaged over 50 energies 
and 10 zenith angles, as explained in the main text. 



X. APPENDIX C: ATMOSPHERIC DENSITY MATRIX 

One may go beyond the evolution of just the single atmospheric flavor i/^. An atmospheric 
density operator will characterize the incoherent flavor mixture produced in the atmosphere. 
For example, taking the flavor content of neutrinos from pion decay, one has 

2 1 

Ppavor] = 3 >< ^mI + 3 We >< ^e\ ■ (79) 

The final density matrix is given by 

pti^Zr]iO)-UEDAUl, (80) 
with weight matrix Da = diag(|, 0, 0, |). The final probabilities are 




We do not pursue this subtlety in the text. 
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FIGURES 




FIG. 1. The zero order sum rule compared to the 90% and 99% exclusion boxes obtained 
from fits to data with small angles set to zero. The vertical axis is -Ratm and the horizontal axis is 
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0.5 - 1.5 GeV 




0.2 0.4 O.e 0.8 1 



■fltm i^jo Earth-Matter 




FIG. 2. Top: 4,000 points, each averaged over incident neutrino ener- 
gies 0.5 GeV < Ey < 1.5 GeV and upcoming angles in —1.0 < cos^^ < —0.8, scattered over 
e^i/ii e^iej Eee, and 6't-s, with matter effects included. The 90% and 99% exclusion boxes obtained 
with small angles set to zero are shown as a crude reference. Bottom: same as above but with 
earth-matter omitted. In both plots, the vertical axis is i?atm and the horizontal axis is -Rsun- 
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1,5 - 30 GeV 




FIG. 3. Same as Fig. 2, but energy-averaged over 1.5 GeV< E^, < 30 GeV. 
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30 - 500 GeV 





FIG. 4. Same as Fig. 2, but energy-averaged over 30 GeV< Ei, < 500 GeV. 
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50 - 150 GeV 





FIG. 5. Same as Fig. 2, but energy-averaged over 50 GeV< Ei, < 150 GeV. 
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0.5 - 1.5 GeV 




1.5 - 30 GeV 




FIG. 7. Same as in Top figure 3, but with only one small-angle (indicated) nonzero. 
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30 - 500 GeV 




FIG. 8. Same as in Top figure 4, but with only one small-angle (indicated) nonzero. 
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50 - 150 GeV 




■Qtm Product-Rule 




FIG. 10. 4,000 points for the product rule, each averaged over incident neutrino energies 
50 GeV < Ey < 150 GeV and upcoming angles in —1.0 < 0086*2 < —0.8, scattered over e^^, 
e^ej fieej and 6*1-3, with matter effects included. Here we use the same -Ratm and Rsun symbols to 
denote the ratios of amphtudes appearing in the product rule eq. (28). The diagonal line is the 
result when small angles are set to zero. 
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1.5 - 30 GeV V 




FIG. 11. Sum rule scatter plot for the antineutrino channel, averaged over the energy range 1.5 
to 30 GeV. 
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